arXiv:1502.01865vl [cs.CC] 6 Feb 2015 


Lower Bounds for Monotone Counting Circuits* 

Stasys Jukna* 

February 9, 2015 


Abstract 

A {+, x}-circuit counts a given multivariate polynomial /, if its values on 0-1 inputs 
are the same as those of /; on other inputs the circuit may output arbitrary values. Such 
a circuit counts the number of monomials of / evaluated to 1 by a given 0-1 input vector 
(with multiplicities given by their coefficients). A circuit decides f if it has the same 0-1 
roots as /. We first show that some multilinear polynomials can be exponentially easier 
to count than to compute them, and can be exponentially easier to decide than to count 
them. Then we give general lower bounds on the size of counting circuits. 
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1 Introduction 

In this paper we consider computational complexity of multivariate polynomials with nonneg¬ 
ative integer coefficients: 

n 

f(xi, • • • ,x n ) = X C e\\ x T > (!) 

eSN™ i= 1 

where c e € N = {0,1,2,...}, and x® = 1. Products {{'Li X T are monomials of /; we will 
often omit monomials whose coefficients c e are zero. The polynomial is multilinear , if c e = 0 
for all e 0 {0, l} n , and is homogeneous of degree d, if e\ + • • • + e n = d for all e with c e / 0. 

A standard model of compact representation of such polynomials (with nonnegative co¬ 
efficients) is that of monotone arithmetic circuits, i.e. of {+, x}-circuits. Such a circuit is a 
directed acyclic graph with three types of nodes: input, addition (+), and multiplication (x). 
Input nodes have fanin zero, and correspond to variables x\,..., x n . All other nodes have 
fanin two, and are called gates. The size of a circuit is the number of gates in it. 

Every {+, x}-circuit syntactically produces a unique monotone polynomial F with non¬ 
negative integer coefficients in a natural way: the polynomial produced at an input gate x t 
consists of a single monomial ay, and the polynomial produced at a sum (product) gate is the 
sum (product) of polynomials produced at its inputs; we use distributivity to write a product 
of polynomials as a sum of monomials. The polynomial F produced by the circuit itself is 
the polynomial produced at its output gate. Given a polynomial f(x i,... ,x n ), we say that 
the circuit 
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Figure 1: A circuit of size 5 counting the polynomial / = 2 xyz + 2 xy + 
2 xz + 2 yz, and deciding the polynomial g = xy + xz + yz. The circuit 
itself produces the polynomial F = (x + y)(y + 2 )(re + z) = 2xyz + x 2 y + 
xy 2 + x 2 z + xz 2 + y 2 z + yz 2 . Gate u is the output gate. 


• computes f, if F(a) = f(a ) holds for all a € N n , where N = {0,1, 2 ,.. 

• counts f, if F(a) = /(a) holds for all a E {0, l} n ; 

• decides /, if F(a) = 0 exactly when /(a) = 0 holds for all a E {0, l} n . 

In this paper we are mainly interested in {+, x}-circuits counting a given polynomial /. Such 
a circuit needs only to correctly compute the restriction / : {0, l}™ —>• N of / on 0-1 inputs. 
Note that, if the polynomial / is rnonic (has no coefficients > 1) then, on every 0-1 input 
a E {0, l} n , /(a) is the number of monomials of / satisfied by (evaluated to 1 on) a. For 
example, in the case of the permanent polynomial 

n 

Per n (x) = ^ II x hh(%) 
h i= 1 

with the summation over all permutations h of [n] = {l,...,n}, the value Per n (a) is the 
number of perfect matchings in the bipartite nxn graph G a specified by input a E {0, l} nxn ; 
nodes i and j are adjacent in G a if and only if a t j = 1. Thus, a circuit counting Per outputs 
the number of perfect matchings in G a , whereas a circuit deciding this polynomial merely 
tells us whether G a contains a perfect matching. 

Remark 1. Let us stress that we only consider monotone arithmetic circuits. The reason 
is that counting {+, —, x}-circuits are already omnipotent: they are as powerful as boolean 
{V, A, -i}-circuits. This is because each boolean operation can be simulated over {0,1}: x A y 
by xy, —<x by 1 — x, and xVybyx + y — xy. 

If a {+, x}-circuit computes, counts or only decides a given polynomial /, what can then 
be said about the structure of the produced by the circuit polynomial FI 

If the circuit computes /, then F = f must hold, that is, then the produced polynomial F 
and the target polynomial / must coincide as formal expressions, i.e. as sums of monomials 
(see, e.g. Claim flOl below for simple a proof). In particular, then mon(F’) = mon(/) must 
also hold, where 

• mon(/) is the set of monomials appearing in / with nonzero coefficients. 

This ensures that no “invalid” monomials can be formed during the computation, and severely 
limits the power of such circuits. In particular, if the target polynomial / is multilinear (no 
variable has degree larger than 1, then the circuit itself must be multilinear: the polynomials 
produced at inputs of each product gate must depend on disjoint sets of variables. This limi¬ 
tation is essentially exploited in all lower bounds for monotone arithmetic circuits, including 

In counting circuits, mon(T) = mon(/) needs not to hold, due to the multiplicative 
idempotence axiom x 2 = x valid on 0-1 inputs. That is, here exponents (and hence, degrees 
of monomials) do not mater (see Fig. []]). Still, it can be shown (see Lemma [5] below) that 
here we have a weaker, but still strong enough property sup (F) = sup(/), where 
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• sup(/) is the support of /, that is, the family of sets of variables of monomials in mon(/). 

In deciding circuits, even sup(I ? ) = sup(/) needs not to hold, due to the additional 
absorption axiom x+xy = x. In such circuits, we only have a weak property min(.F) = min(/), 
where 

• min(/) C sup(/) is the family of all members of sup(/) which are minimal in the 
sense than they do not contain any other members of sup(/); hence, min(/) forms an 
antichain. 

Deciding {+, x}-circuits are actually monotone boolean circuits, and we have the following 
relations concerning the minimum circuit size for every given polynomial (we will prove that 
both gaps can be exponential): 

Deciding ^ Counting ^ Computing. 

To prove lower bounds for deciding, and hence, also for counting {+, x}-circuits, one can use 
lower-bounds arguments for monotone boolean circuits (see, e.g. [T2j Chapt. 9] and the liter¬ 
ature cited herein), but these are not easy to apply. The reason here lies in a “dual character” 
of these arguments: in order to obtain a large lower bound on the decision complexity of a 
given polynomial /, not only the set of monomials of the polynomial / itself but also that 
of the “dual” polynomial f* must have some good structural properties (see the discussion 
before Theorem [8] below). 

On the other hand, due to the limitations we mentioned above, lower bounds for {+, x}- 
circuits computing a given polynomial are relatively easy to obtain, because here we have a 
full knowledge about the polynomial which a circuit must produce. In particular, there is 
then no need to consider dual polynomials. Counting {+, x}-circuits allow more freedom, 
because they can use x 2 = x. In this case we only know the structure of the support of the 
produced polynomial, but not about its monomials. So, it is natural to ask whether known 
lower bounds for exactly computing {+, x}-circuits can be extended to counting circuits? 

That they sometimes can be extended was demonstrated by Sengupta and Venkateswaran 
in [18] , where they show that an exponential lower bound of Jerrum and Snir m for {+, x}- 
circuits computing the permanent polynomial Per can be adopted to yield the same lower 
bound for circuits only counting this polynomial. Still, at least three questions remained 
open: 

1. Can counting circuits be substantially smaller than computing circuits? 

2. Can deciding circuits be substantially smaller than counting circuits? 

3. Can lower-bounds arguments for computing {+, x}-circuits, not just bounds for specific 
polynomials (like the permanent polynomial), be extended to {+, x}-counting circuits? 

In this paper, we answer these questions affirmatively. 

2 Results 

For a polynomial /, let C(/) denote the minimum size of a {+, x}-circuit computing /, C 0 /i(/) 
the minimum size of such a circuit counting /, and D(/) the minimum size of a {+, x}-circuit 
deciding f. Note that, for every polynomial /, we have that 

d(/Kc 0 / 1 (/kc(/). 
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We first show that the gaps C(f)/C 0/1 (f) as well as C 0/1 (f)/D(f) can be exponential. When 
doing this, we will use known lower bound for the permanent polynomial. 

Theorem 1 ([TUI IS])- If f = Per n , then C 0/1 (f) ^ n2 n ~ l . 

This lower bound on C(/) was proved by Jerrum and Snir [TO] , and was extended to 
C 0/ i (/) by Sengupta and Venkateswaran [18] (see also Corollary Q] below for a short proof of 
a weaker 2^”) lower bound). 

We will also use the (simple) fact that it is not harder to compute the so-called “lower” 
and “higher” envelopes of polynomial than to compute the polynomial itself. The lower 
envelope of a polynomial / is a homogeneous polynomial f\ e consisting of the monomials of / 
of smallest degree. The higher envelope fh e is defined by taking monomials of largest degree. 
(As usually, the degree of a monomial is the sum of exponents of its variables, and a polynomial 
is homogeneous, if all its monomials have the same degree.) As observed already by Jerrum 
and Snir [TO] , every {+, x}-circuit producing a polynomial / can be easily transformed into 
a circuit producing f\ e or /h e by just discarding (if necessary) some of the sum-gates. Hence, 
we always have 

C(/) ^ max{C(/he), C(/i e } . (2) 


2.1 Gaps 

To show that the gap C(/)/C 0 /i(/) can be exponential, we will show a stronger fact that both 
gaps C 0 /i(/he)/Co/i(/) and C 0/1 (/ie)/C 0 /i(/) can be exponential. Recall that, by (|2|) . no such 
gap is possible for computing {+, x}-circuits. 

Theorem 2. There are multilinear polynomials f and g of n variables such that C 0 /\(/) = 
0(n) and C 0/1 (g) = 0(n 3/2 ), but both C 0/1 {f he ) and C 0/1 (g \ e ) are 

Remark 2. Together with ([2]) . the theorem implies that the gap C(/)/C 0 /i(/) between the 
sizes of {+, x}-circuits computing and counting / can be exponential. Important in this result 
is that the gap is obtained for multilinear polynomials: this shows that, under the presence of 
multiplicative idempotence x 2 = x, non-multilinear circuits counting multilinear polynomials 
can be much more efficient. In this connection, let us mention that without this restriction (to 
multilinear polynomials) a non-trivial gap follows from the classical lower bound H(nlogd) of 
Strassen [23], and Baur and Strassen [2] on the size of arithmetic (not necessarily monotone) 
circuits computing the polynomial / = xf + x$ + • • • + x%, which can be trivially counted by 
a {+, x }-circuit F = x\ + x% + • • • + x n of size only n — 1. But this example merely says that, 
under the presence of multiplicative idempotence x 2 = x, rising to powers is redundant. 

To show that the gap C 0/1 (/)/D(/) can also be exponential, it is enough to take any 
polynomial g{x i,... ,x n ) such that C 0 / 1 ( 9 ) is exponential, and consider the polynomial / = 
g + h where h = Yffi=i x %- H <7(0, ... , 0) = 0 then, on every 0-1 input a, we have that /(a) = 0 
if and only if h(a ) = 0. So, / has a small decision complexity: D(/) ^ D (h) ^ n. So, 
if the counting complexity C 0 /i (/) of the extended polynomial / remains exponential, then 
the gap C 0 /i(/)/D(/) is exponential. In particular, one can establish such a gap by using 
the permanent polynomial g = Per (the only small “technicality” here is to show that the 
counting complexity of / remains large). 

Theorem 3. If f = Per n + Yn,j=i x ij> then D (/) ^ n2 but c o/i(/) = 2 n(n) . 
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The polynomial used in this theorem is somewhat artificial. Actually, one can establish 
an exponential gap using a more natural (and important) s-t path polynomial Path^. This 
polynomial has one variable x'jj for each edge of a complete undirected graph on n + 2 nodes 
{s, 1,2,..., n, t}. Each monomial of / corresponds to a simple directed path from node s to 
node t: 

n 

Path n (x) — X s ,t -p ''y ^ ■ 

1=1 

distinct 

On a 0-1 input a, Path n (o) gives the number of s-t paths in the graph specified by a. Jerrum 
and Snir |10] have shown that every {+, x}-circuit computing f = Path,, must have exponen¬ 
tial size, i.e. that C(/) = 2^ n ). We show that even {+, x}-circuits counting Path must have 
exponential size. 

Theorem 4. If f = Path n , then D(/) = 0(n 3 ), but C 0/1 (f) ^ 2 nfl(1) . 

2.2 Lower bounds 

Recall that, if a {+, x}-circuit computes a given polynomial /, then the produced by the 
circuit polynomial F must just coincide with / (as formal expressions). In counting and 
deciding circuits we only have weaker conditions on F. 

By the linearization of a polynomial / we will mean a multilinear polynomial / obtained 
from / by removing all (nonzero) exponents from all monomials of /. For example, the 
linearization of / = 2 xy 2 + 3 x 4 y 2 + 6 y 2 z is / = 5 xy + 6 yz. It is clear that /(a) = /(a) holds 
for all a € {0, l} n . 

Lemma 5. If a {+, x}-circuit producing a polynomial F counts f, then F = f, and hence, 
also sup(F) = sup(/). A {+, x}-circuit decides f if and only if rniri(T) = min(/). 

Our next structural result is the following lemma. The support of a monomial is the 
set of variables appearing in it with nonzero degree; the size of this set is the length of the 
monomial. A product gh of two polynomials is m-balanced , if the minimum length l of one 
these polynomials satisfies m/3 < l ^ 2m/3. A monomial p appears m-balanced in a product 
gh of two polynomials, if there are monomials r € rnon(g) and s € rnon(h) such that rs and 
p have the same support, and the length l of r satisfies m/3 < l ^ 2m/3. Note that here 
the order of polynomials in their product gh is important: the condition is only on parts 
of monomials appearing in the first polynomial. In particular, if several monomials appear 
m-balanced in gh, then we know the bounds on the lengths of their parts in one and the same 
of the two polynomials. 

Lemma 6. Let m ^ 2, and let f a polynomial of counting complexity C 0 /i(/) = s. 

(i) If every monomial of f has length at least m, then sup(/) is a union of at most s 
supports of m-balanced products of polynomials. 

(ii) There are s products gh of polynomials such that sup (gh) C sup(/), and every monomial 
of f of length at least m appears m-balanced in at least one of these products. 

Various versions of claim (i) (with degree of or the total number of variables in polynomials 
used instead of their length) were observed by several authors including Hyafil [9], Jerrum 
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and Snir [TO] . Valiant E3, and Raz and Yehudayoff [16j. The advantage of claim (ii) is its 
wider applicability: the polynomial / itself is allowed to have also short monomials, shorter 
than m. 

Our next results are more explicit lower bounds for counting circuits. The r-th degree, 
ff r (A), of a family of sets A is the maximum number of sets in A containing a fixed r-element 
set: 

# r (A) = max | {a E A: a D 6}|. 

\b\=r 

In other words, the intersection of any ff r {A) sets in A can have at most r elements. Note 
that 

\A\ = #o(A) ^ #i(A) ^ ... ^ # r (A) = 1 > 0 = # r+ i(A ). 

where r = max{|a|: a E A}. Also, A C B implies ff r {A) ^ ff r {B). If A is a graph (viewed as 
a set of edges), then #i(A) is the maximum degree of A. In general, # r (A) is related with 
|A| as follows: if A is a family of m-element subsets on [n], then for every r rri we have that 

This can be shown by counting in two ways the number M of pairs (a, b), where a € A, |6| = r 
and a D b holds. By first fixing sets a € A, we get that M is equal to the left-hand side. By 
fixing sets b, and taking all possible m-element sets a containing b, we get that M is at most 
the right-hand size. 

As we mentioned in the introduction, lower bounds for deciding, and hence, also for count¬ 
ing {+, x [-circuits, can be obtained using lower-bounds arguments for monotone boolean 
circuits (see, e.g. [T5J Chapt. 9] and the literature cited herein), but these are not easy to 
apply. The reason here lies in a “dual character” of these arguments: in order to obtain a 
large lower bound of the decision complexity of a polynomial / given by not only the 
set of monomials of / itself but also that of its “dual” f* must have some good structural 
properties. The dual f* of a polynomial 

/ = Cu II Xi is f* = II Xi ■ 

uC[n] i£u u:c u >0 i£u 

Note that, for every 0-1 input a = (a\,..., a n ), f(a ) = 0 if and only if f*(a) / 0, where 
a = (1 — ai,..., 1 — a n ). This holds, because every set in sup(/*) intersects every set in 
sup(/). More precisely, a general lower bound for deciding {+, x}-circuits is the following. 

Theorem 7 m ). Let f{x i,..., x n ) be a polynomial, and 2 ^ r, s ^ n be integers. Then for 
every A C sup(/) and B C sup(/*) such that #i(A) ^ |A|/2(s — 1), we have 

D(/)^mm { 2(s _ 1 )r! #r( ^ 4) , (r _ l) s -# S {B) } ' 

As shown in El (see also pjj Chapt. 9]), this criterion allows to obtain strong (super¬ 
polynomial) lower bounds on D(/), and hence, also on C 0/1 if) and C(/), for some explicit 
polynomials. The strength of this criterion lies in the possibility to arbitrarily chose both 
the parameters r, s as well as sub-families A and B. The weakness, however, lies in its “dual 
nature” making it not easy to apply: both |A|/#>(A) and \B\/ff s {B) must be large. It is 
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usually easy to ensure that \A\/ff r (A) is large. The problem, however, is with the dual set B, 
because the set of monomials of the dual polynomial f* may be rather “messy”, even though 
the polynomial / itself has a “nice” structure. Say, if / = Per n , then \A\/ff r {A) = n\/{n — r)\ 
is large enough already for A = sup(/). But monomials of f* correspond then to complements 
of graphs without perfect matchings, and it is difficult to ensure that \B\/ff s (B) is also large 
for some family B of such graphs. 

For counting {+, x}-circuits, we have a much more handy lower-bounds criterion, avoiding 
the need of dual polynomials. By the r-th degree, ff r {f)i of a polynomial / we will mean 
the r-th degree # r (A) of its support A = sup(/). Thus, if / is multilinear, then # r (/) is the 
maximum number of monomials of / containing a common factor of degree r. 


Theorem 8. Let f = g + h be a polynomial such that every monomial of g has at least m ^ 2 
variables, and every monomial of h has fewer than m/3 variables. Then there is an integer r 
between m/3 and 2m/3 such that 


Co/i (/) ^ 


|sup(g)| 

#r{g) ' ffm—r (<?) 


(3) 


There is yet another general lower-bounds criterion for monotone arithmetic circuits, due 
to Gashkov [6], and Gashkov and Sergeev [7]- They call a polynomial / {k,l)-sparse, if 


mon (gh) C mon(/) implies |mon(g)| ^ k or |mon(/i)| ^ l. 

They proved that C(/) + 1 ^ |mon(/)|/max{£; 3 , l 2 } holds for every such polynomial. Note 
that the bound is not trivial, because the fact that |mon(g)| ^ k or |mon(/i)| ^ l holds does 
not imply that |mon(g , /i)| ^ kl must also hold (because we have an “or”, not “and” here). To 
obtain a similar lower bound for counting circuits, we will modify their notion of “sparsity”. 

Let, as before, min(/) C sup(/) denote the family of all members of sup(/) which are 
minimal in the sense than they do not contain any other members of sup(/). Call a polynomial 
f (k, l)-free if, for every two polynomials g and h, 


sup (gh) C sup(/) implies |min(g)| ^ k or |min(/i)| ^ l. 


The reason to only require |min(</)| ^ k instead of |sup(g)| ^ k is that then it is (potentially) 
easier to show that a given polynomial is (fc,Z)-free: |min(g)| can be much smaller than 
|sup(c/)|. 


Theorem 9. Let 1 ^ k ^ l be integers. For every ( k,l)-free polynomial f, its support sup(/) 
is a union of at most 2C 0 /i (/) supports sup (gh) of products gh of polynomials such that 
|min(g/i)| ^ kl 2 . In particular, 


Co/i (/) ^ 


min(/)| 
2 kl 2 


Remark 3. The proofs of Theorems E] and [9] extend to C 0/1 (f ) the arguments used in [6j[?, .13j 
to lower-bound C(/). The main difficulty with the extension (stipulated by the idempotence 
axiom x 2 = x ) is that, unlike the measure g(f) = |mon(/)| (used to lower-bound C(/)), the 
measures |sup(/)| and |min(/)| are no more “monotone ” in the sense that g(f) ^ g(fg). To 
see this, take, for example, f = xi + X 2 + ■ ■ ■ + x n and g = X\X 2 ■ ■ ■ x n . Then |sup(/)| = n 
but |sup(/c/)| = 1. 

Remark 4. The proofs of Theorems [8] and [9] are based on the fact (Lemma O that, if a {+, x}- 
circuit counts a polynomial /, then the produced by the circuit polynomial F must satisfy 
sup(F) = sup(/). Thus, these bounds do not extend to monotone boolean circuits, where we 
only have a much weaker property miri(F) = min(/). 
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3 Some Applications 


Theorem [8] allows us to easily obtain strong lower bounds on C 0 /i(/) for many polynomials. 
Let us demonstrate this on some of them. First, associate with very set H of permutations 
h : [n] —>• [n] the polynomial in n 2 variables Xij: 


n 

Ih{x) = Yl x i,h(i ) • 

h(E:H i =1 


For example, if H consists of all permutations, then fu is the permanent polynomial Per n . 
If H consists of al cyclic permutations, then the monomial of fn correspond to Hamiltonian 
cycles in K n . 


Corollary 1. For every set H of permutations of [n ], there is an r such that n/3 < r ^ 2n/3 
and 


c „„(/)s 


ESI 

n! 


In particular, C 0/ i(Per n ) ^ (/) = 2 Q(n) . 


Proof. The polynomial fn has \H\ monomials, each specified by a permutation h € H of [n]. 
If some r variables are fixed, this fixes r values of h. Hence, at most (n—r) \ of the permutations 
can take r pre-described values, implying that # r (/) ^ (n — r)\. Thus, Theorem [8] gives that 
C 0 /i(/) is at least \H\ divided by the maximum of r\(n — r)\ over all n/3 < r ^ 2n/3. □ 


In some cases, Theorem [8] allows to even obtain almost optimal bounds. A partial t- 
(n, m, A) design is a family A of m-element subsets of {1,..., n} such that any t-element set is 
contained in at most A of its members. We can associate with each such design A a multilinear 
polynomial 

fA(x) = 

a£A i&a 


Corollary 2. For every partial t-(n , m, A) design A with m/3 ^ t ^ 2m/3, we have C 0 /i (/a) ^ 
\A\/\r 


Proof. For all m/3 ^ r ^ 2m/3, we have that both r and m — r are at least m/3. Thus, the 
design property implies that both # r (A) and # m _ r (A) are at most A, and the desired lower 
bound follows directly from Theorem [8) □ 

There are many explicit partial designs A with A << For every of them, the 

counting complexity of the polynomial fA is almost the same as the number of monomials. 
To give an example, let n be a prime power, and let A consist of all subsets a = {(z, h(i ): i £ 
GF(?r)} of the grid GF(n) x GF(n) corresponding to polynomials h{z) of degree at most d— 1 
over GF(n). Since no two distinct polynomials of degree < d can coincide on d points, we 
have that no two monomials of / can share d variables in common, A is a partial l-(n 2 ,n, 1) 
design, and we obtain n d = |A| ^ C 0 /i(/ a) ^ n d+1 . 

Theorem [9] is more difficult to apply than Theorem [8j but it may help for polynomials, 
on which the latter theorem fails. To demonstrate this, let A be a set of edges of a bipartite 
point-line incidence graph of a projective plane PG(2,q), introduced by Singer [2D]. The 
nodes on the left-side correspond to n = q 2 + q + 1 points x. and those on the left-side to n 



lines L , and x and L are adjacent if x € L. Since every line L has \L\ = q + 1 points, and 
every point lies in q + 1 lines, this is a d-regular graph of degree d = q + 1 > yfn. Moreover, 
the graph is I\ 2 , 2 -free (i.e. contains no complete 2 x 2 subgraphs), because every two point 
lie in only one line, and every two lines share only one point. For the polynomial 

Ia(x) = 22 XuXv > 

UV€lA 

Theorem [ 8 ] can only give a trivial lower bound C 0 /i(/a) ^ |x4|/cZ 2 = Indeed, in this 

case we have m = 2, and hence, r = 1. But then both # r (/yi) and Jf m -r{fA ) are equal 
d > yfn. On the other hand, it is not difficult to verify that the 2 -freeness of A implies 
that the polynomial Ja is (k. 1 )-free for k = l = 1. Thus, Theorem [9] yields an almost optimal 
lower bound 

C o/ i(/ A ) = 0(n 3 / 2 ). 

As a second example, let us consider the structurally much simpler triangle polynomial of 
n = 3 m 2 variables with m 3 = 0 (n 3//2 ) monomials: 

A n (x,y,z)= 22 X ikVkjZij ■ 

i,j,ke[m] 

Schnorr m has shown that C(A n ) = 0(n 3//2 ); this also follows from the lower bound of 
Gashkov and Sergeev [7] mentioned above, because the polynomial is (1, l)-sparse: any trian¬ 
gle is uniquely determined by any two of its edges. 

Concerning counting circuit complexity of / = A n , Theorem [ 8 ] can only yield a trivial 
lower bound C 0/ i (/) ^ m 3 /m = m 2 = n/3, because up to m triangles can share a common 
edge. Still, Theorem [9] (with some more effort) allows us to obtain an almost optimal lower 
bound. 

Corollary 3. If f = A n , then C 0/1 (/) = 0(n 3 / 2 ). 

Proof. The upper bound C 0 /i(/) = 0(m 3 ) = 0(n 3 / 2 ) is trivial. To prove the lower bound 
Co/i(/) = f2(m 3 ), we will use Theorem G3 Since |sup(/)| = m 3 , it is enough to show that 
/ is (1, l)-free. To show this, assume that sup (gh) C sup(/) for some polynomials g and h 
such that |min(g)| ^ 2 and |min(/r)| ^ 2. Take any two sets 01,02 € min(g), and two sets 
61,62 £ rriin(h). Then all four unions a* U bj must be triangles (not just contain a triangle). 
Moreover, ai and 02 , as well as b± and 62 must be incomparable under inclusion. 

Case 1: Some of the sets ai, 02 , 61 , 62 forms a triangle T, say oi = T. Hence, b\ and &2 lie 
in T, and 02 2 T since 01 and 02 must be incomparable. Consider the triangles T\ = 02 U 61 
and T 2 = 02 U 62 . If | 6 j| ^ 2 for some i € {1, 2}, then |T) n T\ ^ | 6 *| ^ 2, implying that T; = T, 
and hence, also 02 C T, a contradiction. So, 61 = {ei} and 62 = {e 2 } for some edges ei 7 ^ e 2 - 
Since then | a. 2 1 ^ 2 , the triangles Ti and T 2 are uniquely determined by 02 , implying that 
Tj = T -2 must be the same triangle. But this triangle shares two distinct edges ei and e 2 with 
T, implying that T\ = T, and hence also a -2 C T, a contradiction. 

Case 2: None of the sets oi, 02 , 61,62 forms a triangle. In this case, some of the sets must 
have exactly two edges, say ai = {ei,e 2 }. Since a triangle is uniquely determined by any 
two of its edges, we have that both unions ai U 61 and ai U 62 must form the same triangle 
T = {ei, e 2 , 63 }. The sets 61 and 62 must be incomparable, and both of them must contain the 
“missing” edge e 3 . Since none of these two sets can be a triangle, this implies that 61 = {ei, 63 } 
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and 62 = {e 2 , e 3 }. These two sets also uniquely determine the same triangle T, implying that 
a 2 U b\ = a 2 U 62 = T. Thus, 02 must contain both missing edges e\ and e 2 of T. But this 
means that 02 contains the set oq, a contradiction with a\ and 02 being incomparable. □ 

We now turn to the proofs of our main results. 

4 Proof of Theorem [2] 

To show that the gap C(/h e )/C(/) can be exponential, consider the following polynomial in 
n = m 2 + m variables: 

m m 

Per*(x, 2/) = II S Xi i y i ' ( 4 ) 

i= 1 j =1 

The relation to the permanent polynomial Per is that the coefficient of the monomial y\y 2 ■ • • y m 
in Per *(x,y) is exactly Per m (x). 

Now, let f(x,y ) be the linearization of Per *(x,y). That is, f(x,y) is a multilinear polyno¬ 
mial obtained from Per* (a;, y) by removing all nonzero exponents from all monomials. Every 
monomial of / has degree (sum of exponents) between m + 1 and 2 m, and the monomials 

x 1 ,ji X 2 J 2 ''' xmjmyrn ■ ■ ■ ym 

of degree 2 m with all j 1 ,..., j m distinct are exactly the monomials of the polynomial 

h(x, y) = Per m (x) • yiy 2 

Thus, h = /he is the higher envelope of /. Since h(x, 1,..., 1) = Per m (x), Theorem |T] yields 

Co/i (/he) > C 0 / 1 (Per m ) = 2 ^ . 

On the other hand, since exponents play no role on 0-1 inputs, we have that Per* (a) = /(a) 
holds for all 0-1 inputs a. Thus, the polynomial / can be counted by the circuit given by the 
definition (HJ) of Per*. This gives the desired upper bound C 0/1 (f) = 0(m 2 ) = 0(n). 

To show that the gap C(g\ e )/C(g) can also be exponential, consider the following polyno¬ 
mial in n = m 2 variables Xij given by the formula: 

m 2m / 2m \ ✓ m \ 

\so\ n (x) =n n e ^)(e xij J . (5) 

i=lj=m+l ' k=m+l ' ^ /=! 

The monomials of this polynomial are obtained as follows. We interpret the variables x^ 
as edges of a complete bipartite m x m graph I x J with parts I = {1,... , m} and J = 
{m + 1,..., 2m}. To get a monomial of Isol, we take, for each node i £ / exactly one edge 
Xik incident with i, and take, for each node j € J exactly one edge xij incident with j. So, 
every variable has degree at most 2. Note that on every 0-1 input a € (0, l} n , Isol (a) = 0 if 
and only if the graph specified by a has an isolated node. 

Let g be the linearization of lsol n . Every monomial of g has degree between m and 2m, 
and the monomials of degree m correspond to perfect matchings. Thus, the lower envelope 
g\ e of g is just the permanent polynomial, i.e. g\ e = Per m . By Theorem [Q C(< 7 i e ) = 

On the other hand, since exponents play no role on 0-1 inputs, we have that Isol (a) = g(a) 
holds for all 0-1 inputs a. Thus, the polynomial g can be counted by the circuit given by the 
definition ((5]) of Isol. This gives the desired upper bound C 0 /i(g) = 0(m 3 ) = 0(n 3//2 ). □ 
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5 Proof of Theorem [4] 


Recall that the s-t path polynomial / = Path n has one variable Xij for each edge of a complete 
undirected graph on n + 2 nodes {s, 1,... , n, t}. Each monomial of / corresponds to a simple 
directed path from node s to node t. 

The upper bound D (/) = 0(n 3 ) of the decision complexity of / = Path n follows from the 
Bellman-Ford dynamic programming algorithm 13 El. The circuit is constructed recursively 
by taking F\j = x s j for all j £ [n] U {f}, and using the recursion Fi + ij = Fij + Yli+j ^l,i x x i,j 
for j £ [n]U{t}. Monomials of Fij correspond to walks from node s to node j passing through 
at most l edges; one edge may be passed more than once, and each pass counts. The output 
is the polynomial F = F n +\j. Since every s-t walk contains a simple s-t path, and since in 
deciding {+, x}-circuits we can use the absorption axiom x + xy = x, the circuit correctly 
decides Path n . Thus D(Path n ) = 0(n 3 ). 

Our goal is now to show that every {+, x}-circuit counting the s-t path polynomial must 
have exponential size. We do not have a direct proof of this lower bound. Instead, we will 
derive this result indirectly by using some known reductions and lower bounds. 

Say that a {+, x}-circuit decides f with threshold T, if for every a £ {0, l} n , F(a) ^ T 
holds precisely when /(a) Js 1. Here, the threshold T = T(n ) may depend on the number n of 
variables, but not on the input. Note that deciding {+, x}-circuits decide with threshold T = 
1. Let D t h r (/) denote the smallest size of a {+, x}-circuit deciding / with some threshold T. 

As defined by Valiant [26], and Skyum and Valiant m , a polynomial f(x i,..., x n ) 
is a monotone projection of a polynomial g(yi,...,y m ) if there exists an assignment a : 
{yi,...,y m } -£ {xi,... ,x n ,0, 1} such that f(x i,...,x n ) = g(a(yi),... ,a(y m )). It is clear 
that then D thr (/) ^ B thr (g). 

The r-clique polynomial , Clique n r , has Q) variables x e , one for each edge e of K n , and 
has one monomial flees x e f° r ever y subset S C [n] of size |5| = r. Results of Valiant [25] 
imply that, for every 1 ^ r ^ n, Clique n r is a monotone projection of the Hamiltonian s-t 
path polynomial Ham m for m = n°^\ as noted by Alon and Boppana [T], already m = 25 n 2 
is enough in this case. On the other hand, it is known that, for r about y/n, the clique 
polynomial / = Clique n r requires D t h r (/) ^ 2 Tin(1) [ 8 l fT5l IT] ; see, e.g. [ 12 ] Sect. 9.8] for a 
simpler proof. (In fact, this result holds for more general circuits where arbitrary monotone 
real valued functions g : M 2 —>• R can be used as gates.) Since Clique nr is a monotone 
projection of Ham m , we have that 

D t hr(Ham m ) ^ D thr (Clique nr .) = 2 nn(1) . 

It remains therefore to show that 


C 0/ i(Path m ) ^ D thr (Ham n ) for m = n°W. 

This can be shown using a standard reduction of Path to Ham. Let p = (n + 1) log n. Given 
an input graph G on n + 2 nodes {s, 1, 2,... , n, t}, replace each edge (u, v ) by a graph on 
2p + 2 nodes (u, v and 2 p new nodes) containing exactly 2 P paths of length p + 1 between u 
and v. This way, every s-t path of length l in G gives ( 2 P ) l s-t paths in the resulting graph 
G'. This graph has m = 0(pn 2 ) = 0(n 3 logn) nodes. 

If G has a Hamiltonian s-t path (of length n + 1), then the graph G 1 has at least T := 
( 2 P)rc+1 s _f paths. If G has no Hamiltonian path, then the longest s-t path has at most n 
edges, and hence, at most n — 1 inner nodes. The number of s-t paths of length ^ n is 
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bounded from above by n ■ n n ~ 1 = n n . So, in this case, G' can have at most ( 2 p ) n • n n = 
l ■ n n /2 p = T/n s-t paths. We have thus shown that every {+, x}-circuit counting Path. m for 
m = Q(pn 2 ) = 0(n 3 logn) decides Ham n with threshold T = (2 p ) n+1 . □ 

6 Proof of Lemma [5] 

Let f{x i,... ,x n ) be a polynomial in which each variable Xi has degree at most fj, and let 
Si C N be arbitrary subsets of sizes \Si\ ^ ti + 1, i = 1,... ,n. 

Claim 10 (Folklore). The polynomial f is uniquely determined by its values on S\ x S 2 x 

■ ■ ■ x S n . 

Proof. Induction on n. For n = 1, the claim is simply the assertion that a non-zero polynomial 
of degree t\ in one variable can have at most t\ distinct roots. For the induction step, expand 
the polynomial / by the variable x n : 

tn 

f(x 1, ..., X n ) = ^2 • • • ) x n- 1) • x h ■ 

i=0 

For each point a E S\ x ■ ■ ■ x S n - 1 , 


tn 

f(a,x n ) = ^fi(a) ■ x l n 

i=0 

is a polynomial of degree at most t n in one variable, and hence, all its coefficients /,-(a), 
i = 0,1 ,t n can be recovered knowing the values f(a,b) for all b E S n+ \. Knowing the 
values fi(a ) for all a € S± x ■ ■ ■ x S n - 1 we can, by the induction hypothesis, recover the 
polynomials /*, and hence, the original polynomial /. □ 

Now let / and h be two polynomials on the same set of n variables such that /(a) = h(a), 
and hence, also /(a) = h(a) holds for all a € {0, l} n . (Recall that / is obtained from / by 
removing all nonzero exponents.) Since the polynomials / and h are multilinear, Claim flOl 
with all Si = { 0 , 1 } yields f = h (they must coincide as multilinear polynomials), and hence, 
also sup(/) = sup(h) must hold as well. 

Let us now prove the second claim of Lemma [5j if / and h are polynomials on the same 
set of variables, then / and h have the same 0-1 roots if and only if min(/) = rnin(L). The 
“if” part is trivial, because /(a) > 0 happens precisely when p(a) = 1 for some monomial 
p E min(/). To prove the “only if” direction, assume that / and h have the same 0-1 roots. 
Our goal is to show that then min(/) = rnin(L) must hold. 

Assume contrariwise that there is a monomial p € mon(/) whose set of variables X p 
belongs to min(/) but not to min(/t). If X q % X p holds for all monomials q of h, then we can 
set all variables in X p to 1 and the rest to 0. On the resulting assignment a = a p , we will have 
h(a) = 0 but /(a) ^ p(a) ^ 1, a contradiction. Thus, there must be a monomial q E min(h) 
such that X q C X p \ the inclusion must be proper, because X p 0 min(h). But then on the 
input a q , we will have f(a q ) = 0 but h(a q ) ^ q{a q ) ^ 1 , a contradiction again. □ 
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7 Proof of Lemma [6] 


We will need the following two simple and well-known facts. 

A subadditive weighting of a circuit is an assignment of nonnegative numbers (weights) to 
its gates such that the weight of a gate does not exceed the sum of the weights of its inputs. 

Claim 11 (Folklore). If the output gate gets weight m, and every leaf gets weight at most 
2m/3, then there is a gate of weight larger than m/3 and at most 2m /3. 

Proof. By starting at the output gate, and traversing the circuit by always choosing the input 
of larger weight, we can find a gate v of weight > 2m/3 such that both its inputs u and w 
have weights at most 2m/ 3. By the subadditivity of weighting, at least one of the gates u 
and w have then weight larger than (2m/3)/2 = m/3 and at most 2m/3. □ 

Claim 12 (Folklore). For every gate u in a {+, x}-circuit producing a polynomial F, the 
polynomial can be written as F = PQ + R, where P is the polynomial produced at u. 

(We use capital letters for polynomials only to stress that they are produced by circuits.) 

Proof. If we replace the gate u by a new variable y, the resulting circuit produces a polynomial 
of the form yH+R for some polynomial H , where R does not contain y (albeit H may contain). 
It remains to substitute all occurrences of the variable y with the polynomial P produced at 
the gate u. □ 

Proof of Lemma {^(i). For a polynomial /, let 1(f) denote the minimum number of variables 
in a monomial of /. Hence, a product gh of two polynomials is m-balanced, if m/3 < 1(g) ^ 
2m/3. We have to show that, if 1(f) ^ m for m ^ 2, then sup(/) is a union of at most 
s = C 0/ i (/) supports of m-balanced products of polynomials. 

To prove this claim, fix a {+, x}-circuit of size s = C 0/1 (f) counting /. Define the weight 
of a gate u as l(P), where P = P u is the polynomial produced at u. Hence, the output gate 
has weight at least m ^ 2, and each input gate has weight 1 (which is ^ 2m/3 since m ^ 2). 
Since this weighting is subadditive, Claim fill gives us a gate u with m/3 < l(P) ^ 2m/3. By 
Claim fl2l we can write the produced by our circuit polynomial F as a sum F = PQ + R. 
Hence, sup (/) = sup(F) = sup (PQ) U sup(i?), where the product PQ is ?n-balanced. 

The polynomial R is obtained from F by removing some monomials. If R is empty, then 
we are done. Otherwise, the polynomial R can be produced by a circuit with one gate fewer 
(gate u is set to constant 0, and disappears). Moreover, mon(i?) C mon(F) implies that 
l(R) ^ /(F) ^ m still holds. So, we can repeat the same argument for the polynomial R, 
until the empty polynomial R is obtained. □ 

Proof of Lemma{^(ii). We will now apply Claim fill not to the entire circuit but to some its 
sub-circuits. A parse-subcircuit of a circuit F is obtained by setting to 0 one of the two inputs 
of each sum gate. Such a subcircuit F' can also be defined inductively as follows. The output 
gate of F is included in F'. If a gate u is already included in F', and if u is a sum gate, 
then exactly one of the inputs to u are included in F'. If u is a product gate, then both its 
inputs are included in F' (see Fig. O. Note that each parse-subcircuit produces exactly one 
monomial in a natural way, and that each monomial of the polynomial produced by the entire 
circuit is produced by at least one parse-subcircuit. 

Now let F be a circuit of size s = C 0/1 (f) counting /, and F be the polynomial produced by 
F. By LemmalU we have that sup(/) = sup(F). For every monomial p of F of length at least 
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Figure 2: A circuit and two its parse sub-circuits producing, respectively, the monomials xz 2 
and xy. 

m, take some parse-subcircuit F p producing p, and use Claim [TT] to find a gate u in F p such 
that the part p' of p produced at u in F p has length l satisfying m/3 < l ^ 2m/3. By Claim [T2l 
we can write the polynomial F as a sum F = PQ + R, where P is the polynomial produced at 
gate u (in the entire circuit). Hence, p appears m-balanced in the product R u = PQ. Since 
we have at most s products R u , and since mon(i? u ) C rrion(F) implies sup(i2 u ) C sup(/), we 
are done. □ 

8 Proof of Theorems [8] and |3] 

Define the join of two families of sets B and C as the family 

B * C = {bU c: b £ B,c £ C} 

of all possible unions. Note that the support of a product gh of two polynomials is the join 
of the supports of g and h. Note also that, if no set of B intersects any set of C, then we 
have an upper bound |A| ^ #\ b \(A) ■ ff\ c \ (A) on the size of the join A = B * C holding for 
all b e B and c € C. This holds because then \B\ = \B * {c}| ^ #| c | (A), and similarly 
| C\ = \{b} * C\ ^ #|;,| (A). If, however, sets in B and in C intersect, then it may happen that 
\B\ |B * {c}\. Still, also then we have a reasonable upper bound. 

Lemma 13. Let B * C be a join of two families, and B * C C A. Suppose that every set in 
B * C has size at least m, and that B or C has a set of size r. Then 

\B * C\ ^ Jfr{A) ■ jf m - r (A) . 

Proof. Assume w.l.o.g. that the family B contains a set b of size | 6 | = r, and let A b = 
{b} *CCi. Associate with every a € A b the family 

C a = {c € C: bU c = a} . 

These families give a partition of C into \A b \ pairwise disjoint subfamilies. Since all sets in 
A b contain the set b of size |i>| = r, we have that 

\Ab\ ^ # r (A). 

On the other hand, for each a € A b , all sets in C a , and hence, also all sets in B * C a contain 
the set a \ b of size \a\b\ ^ m — r, implying that 

I B * C a | ^ # m _ r (A) 
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holds for all a E A b . Now, every set b' U d in B * C belongs to B * C a for a = b U d. So, 

\B * C\ ^ Y, \ B * C “l < J2 #m-r{A) 

a£Af, a£Ab 

^\A b \-# m _ r (A)^# r (A)-# m _ r (A). □ 

Proof of Theorem [3 Let f = g + h be a polynomial such that 1(g) ^ m ^ 2, and 1(h) < m/3; 
here, as before, 1(f) denotes the minimum number of variables in a monomial of /. By 
Lemma [ 6 fii), there are s = C 0 /i(/) products PQ of polynomials such that sup(PQ) C sup(/), 
and every monomial of g appears m-balanced in at least one of these products. 

Claim 14. If sup(PQ) C sup(/), and if at least one monomial of g appears m-balanced in 
PQ, then sup(P<5) C sup(f/) and |sup(P<5)| ^ #r(d) ■ ffm-r(g) f or some m/3 < r ^ 2m/3. 

Proof. To show the inclusion sup (PQ) C sup(g), assume contrariwise that there are a, a' E 
sup(P) and b,b' E sup(Q) such that a U 6 E sup(g), m/3 < |a| ^ 2m/3 but a' U b' E sup(h). 
Since |6'| = l for some l < m/3, the union a Lib' has size l < m/3 < |a U b'\ ^ 2m/3 +1 < m, 
and hence, cannot belong to sup(/), a contradiction with sup(PQ) C sup(/). Thus, sup(PQ) 
must lie entirely within sup(g), as claimed. 

To show the upper bound on |sup(PQ)|, let A = sup(g), B = sup(P) and C = sup(Q)- 
Since 1(g) ^ m, and sup (PQ) C sup(g), we have that every set in B * C = sup (PQ) has at 
least m elements. On the other hand, since some monomial of g appears m-balanced in PQ, 
some set in B must have r elements, for some m/3 < r ^ 2m/3. For this r, Lemma fl3l yields 
\A* B\ = |sup(PQ)| ^ jfr(A) ■ ffm-r(A ), as desired. □ 

Thus, every monomial of g belongs to at least one of s products PQ of polynomials such 
that |sup(PQ)| ^ ff r (g) m H z m-r(g) for some m/3 < r ^ 2 m/r. By taking such an r maximizing 
#r(g) ■ #m-r(g), the desired lower bound s ^ |sup(g)|/# r (g) ■ # m _ r (g) follows. □ 

Proof of Theorem 0. Recall that our polynomial / has the form / = g + h with g = Per n and 
h = Ylij£[ n ] x ij- Hence, 1(g) = n and 1(h) = 1 < n/3. By Theorem [HJ there is an integer r 
between n/3 and 2n/3 such that C 0/1 (f) ^ |sup( 5 )|/^t r ( 5 ) • fj z m - r (g) ^ n!/r!(n — r)\ = 

On the other hand, on every 0-1 input a, we have that f(a) = 0 if and only if h(a) = 0, 
because g( 0,..., 0) = 0. Hence, the circuit h decides f, implying that D(/) = D(/r) ^ n 2 . □ 


9 Proof of Theorem |9| 


By Claim [T2l we know that, for every gate u in a given {+, x}-circuit F, the produced by the 
circuit polynomial F can be written as F = P u Qu + R, where P u is the polynomial produced 
at u, Q u is the polynomial produced “after” the gate u, and R is the polynomial produced by 
the circuit after the gate u is replaced with constant 0. For our argument, it will be convenient 
to introduce the notion of a polynomial Q e produced after an edge e = (u,v) (see Fig. [3]): 


Qe 


Q v if v = u + w, 
Q V P W if v = u x w. 


A set E of edges of F is a cut, if every input-output path in F contains an edge in E. 
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Figure 3: For an edge e = (u,v), the polynomial Q e produced after e is 
the polynomial Q e = Q v produced after the gate v, if v = u + w is & sum 
gate, and is Q e = Q V P W , if v = u x w is a product gate, where P w is the 
polynomial produced before the gate w. 


Claim 15. If E is a cut, then mon(F’) is a union of mon (P u Q e ) over all edges e = (u, v ) 
in E. 

Proof. Take a monomial p of the produced polynomial F, and let F p be any parse-sub circuit 
producing p. Since E forms a cut, the graph F p must contain some edge e = (u, v ) E E. Then 
the monomial p has the form p = p'p" where p' is the monomial produced by the subgraph 
of F p rooted in u. Thus p' belongs to the polynomial P u produced in F before the edge e, 
and p" belongs to the polynomial Q e produced after the edge e. Hence, p belongs to P u Q e > 
as desired. □ 

Proof of Theorem 0 Let F be a {+, x}-circuit of size s = C 0 / i(/) counting /, and let F be 
the polynomial produced by F. By Lemma 0 we know that sup(F) = sup(/). Hence, the 
polynomial F is also (k, l)- free. We first transform the circuit F to a circuit F 7 as follows. For 
every product gate v = u x w in F, one of whose inputs, say u, is small in that |min(P u )| ^ l 
holds, we remove the edge (u, v ) and replace v by a unary (fanin-1) gate v = P u x w of “scalar” 
multiplication by this fixed (small) polynomial P u . If both inputs produce small polynomials, 
then we eliminate only one of them. It is clear that F 7 produces the same polynomial F. In 
particular, sup(P 7 ) = sup(/) holds as well. 

Say that an edge e = (u,v) of F 7 is light , if |min(P, 1 Q e )| ^ hi 2 . To finish the proof of the 
first claim in Theorem [9l it is enough, by Claim [15j to show that every input-output path in 
F 7 must contain at least one light edge. 

To show this, take an arbitrary input-output path in F 7 , and let e = (u,v) be the last 
edge along this path such that |min(P u )| ^ k; hence, |min(P„)| > k. Such an edge must exist 
because |min(xj)| = 1 ^ k, and since we can assume that |min(P)| > k (for otherwise the 
theorem would trivially hold). Together with min(PQ„) C min(P) and |min(P)| > k, the 
(k, l)- freeness of F implies that 

|min(Q„)| < l. 

If v is a sum gate, then Q e = Q v , and hence, also |min(Q e )| ^ l. So, the edge e is light in 
this case: 

|min(P u Q e )| ^ |min(P u )| • |min(Q e )| ^ kl. 

So, assume that v is a product gate. Let u and w be the inputs to v in the original circuit 
F. Since |min(p i )| ^ k ^ l, we have that |min(p /) )| ^ l must hold as well, for otherwise the 
edge e = (u,v) could not exist in F 7 (would be already eliminated when going from F to F 7 ). 
Hence, 

|min(Q e )| = |min(P„Q„)| ^ / 2 . 

So, the edge e is light also in this case: 

|min(P u Q e )| < |min(P u )| • |min(Q e )| ^ kl 2 . 
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Circuits 

x + x = X 

9 

X = X 

x + xy = x 

Property 

Computing 

- 

- 

— 

F = f 

Counting 

- 

/ 

— 

F = f 

Approximating 

/ 

/ 

— 

sup (F) = sup (/) 

Tropical 

/ 

— 

/ 

Min(F) = Min(/) 

Deciding/Boolean 

/ 

/ 

/ 

min(F) = min (/) 


Table 1: Summary of which axioms are allowed (/) in which kind of {+, x}-circuits. The 
last column indicates what property the produced by a circuit polynomial F must satisfy; 
here / is the linearization of / obtained by removing all nonzero exponents. Tropical circuits 
are circuits with x © y = min(x, y) and x <8> y = x + y functions as gates. Finally, Min(/) is 
the set of all monomials of / that contain no other monomial of / as a proper factor. The 
property Min(F) = Min(/) holds only if / is multilinear [101 [13]. 


Since the total number of edges in F' is at most 2s, we have thus shown that the support 
sup(F') = sup(/) is a union of at most 2s families sup(F > (5) with |min(PQ)| ^ kl 2 . Since 
every minimal set of a union of two families must be minimal in at least one of these families, 
this implies that min(/) is contained in (albeit not necessarily equal to) the union of the 
families min(PQ). Hence, the desired lower bound s ^ |min(/)|/2Zfc 2 . □ 

10 Conclusion and Open Problems 

The weakness of monotone arithmetic circuits, i.e. of {+, x}-circuits, computing a given 
polynomial / is stipulated by the fact that the produced by the circuit polynomial F must 
just (syntactically) coincide with /. In particular, then mon(F) = mon(/) must hold. On the 
other pole are {+, x}-circuits just deciding f . These are, in fact, monotone boolean circuits, 
where the idempotence axiom x 2 = x as well as the absorption axiom x + xy = x can be 
used, and hence, here we only have a weaker property rriin(F) = min(/). While proving lower 
bounds in the latter (boolean) model is a relatively difficult task, the severe restriction of the 
former (arithmetic) model makes this task much easier. 

In this paper we considered an intermediate model of counting {+, x}-circuits. In this 
case, it is required that the values of F must coincide with those of / on only 0-1 inputs: on 
other inputs, the values may be different. Thus, counting circuits are {+, x}-circuits that 
are allowed to use the idempotence axiom x 2 = x (but not the absorption axiom x + xy = 
x). These circuits have an intermediate structural property that sup(F) = sup(/) must 
hold (Lemma O. We have shown that counting circuits can be exponentially smaller than 
computing circuits (Theorem [2|), and that deciding circuits can be exponentially smaller than 
counting circuits (Theorem [3]). 

A next natural question was whether lower-bounds arguments for the weak (comput¬ 
ing) model can be extended to work also for the intermediate (counting) model? We have 
shown that such an extension is possible for two lower-bounds arguments (Theorems EH9]) . 
In fact, our proofs of these bounds hold for {+, x}-circuits that only “approximate” a given 
polynomial / in that sup(F) = sup(/) holds for the produced by the circuit polynomial F 
(coefficients play no role in our arguments). Approximating circuits can use both idempotence 
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axioms x + x = x and x 2 = x. (Table [T] summarizes the axioms allowed in various types of 
circuits.) So, these bounds also hold for {U, *{-circuits constructing a given family A C 2 X 
of subsets of a (fixed) finite set. Inputs are single element sets {x} with i£l, and gates are 
set-theoretic union (U) and join (*) of families. A special case of Theorem [ 8 ] (for h = 0) gives 
that, if every set in A has at least m ^ 2 elements, then there is an integer m/3 < r ^ 2m/3 
such that every {U,*}-circuit constructing A must have at least \A\/ff r (A) ■ # m _ r (A) gates. 

A “complementary” in a sense to counting {+, x}-circuits model, also lying between com¬ 
puting {+, x}-circuits and deciding {+, x}-circuits, is that of tropical circuits, i.e. {min,+}- 
circuits. These are {+, x {-circuits, where the sum is interpreted as min{x, y}, and the product 
as x + y. Such a circuit computes a given polynomial / of n variables, if F(a) = f(a ) holds 
for all a E N n , where / is the “tropicalization” of /: 

n n 

f( x ) = Cell xf turns to f(x) = min ^ . 

eeN n i= 1 Cey^o *=1 

For example, if / = xy 2 + 3 y 2 z 3 , then / = min{x + 2y,2y + 3 z}. Tropical circuits are 
important, because many dynamic programming algorithms for minimization problems are 
just recursively constructed tropical circuits. 

The difference from counting { + , x {-circuits is that now the absorption axiom x + xy = x 
is allowed, but the idempotence axiom x 2 = x is not (x + x / x unless x = 0). As shown in 
mm, lower bounds for computing {+, x {-circuits hold also for tropical circuits, as long as 
the target polynomial / is multilinear: in this case we have that T(/) ^ C(/i e ), where T(/) 
is the minimum size of a tropical circuit computing /. In particular, for polynomials which 
are multilinear and homogeneous (all monomials have the same number of variables), tropical 
circuits are no more powerful than computing {+, X {-circuits. Still, for non-homogeneous 
polynomials, tropical circuits can be exponentially more powerful than even counting {+, x{- 
circuits. In fact, both gaps C 0/1 (f)/T(f) and T(/)/C 0 /i(/) can be exponential, meaning that 
tropical and counting {+, x {-circuits are incomparable. 

Proposition 16. There are multilinear polynomials f and g of n variables such that both 
C 0 / i(/)/T(/) andT(g)/C 0/1 (g) are 2 ^/ 

Proof. To show the first gap, consider the permanent polynomial / = Per m + Y2Tj =l x ij on 
n = 77i 2 variables. Theorem [3] gives C 0 /i (/) = But T(/) ^ m 2 = n because / can be 

computed by a tropical circuit F = Ylij x ij whose tropicalization is F = min i t j(xij): since 
variables cannot take negative values, the minimum will be achieved on a single variable. 
Thus, C 0/1 (/)/T(/) = 2 °M. 

To show the second gap, take the multilinear polynomial g considered in the proof of 
Theorem [2l The polynomial g is the linearization of the polynomial lsol n on n = m 2 variables 
given by ©, and has C 0/1 (g) = 0(n 3 / 2 ). On the other hand, every monomial of g has 
degree between m and 2m, and the monomials of degree m correspond to perfect matchings. 
Thus, the lower envelope g\ e of g is just the permanent polynomial, i.e. g\ e = Per m . Since 
C(Per m ) ^ C 0 /i(Per m ) = 2 ^™) ( see Corollary HJ) and T (g) ^ C(<yi e ), the desired lower bound 
T (g) = 2 n ( m ) follows. □ 

As we mentioned above, T(/) ^ C(/i e ) holds for every multilinear polynomial /. Thus, 
if the lower envelope f\ e requires large monotone arithmetic circuits, then the polynomial / 
itself requires large tropical circuits. This, however, does not hold for polynomials whose 
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lower envelopes have small {+, x}-circuits. An important example in this respect is the s-t 
path polynomial / = Path n . Even though we have C(/) = [lOj . the lower envelope of 

/ consist of just one variable x Sit , implying that C(/i e ) = 0. And indeed, the Bellman-Ford 
algorithm (see Sect. [5]) gives T(/) = 0(n 3 ). 

Problem 1. Does T(/) = fl(n 3 ) hold for f = Path n ? 

This would show that the Bellman-Ford algorithm is optimal, if only Min and Plus op¬ 
erations can be used. It is worth to mention that the optimality of the other prominent 
dynamic programming algorithm—that of Floyd-War shall d £H] for the all-pairs shortest 
paths problem—is already known. The corresponding to this problem “polynomial” f n is 
actually a set of s-t path polynomials Path n for all choices of the source and target nodes s 
and t. Thus, unlike for Path n , every circuit for f n must already have Sl(n 2 ) distinct output 
gates. The Ford-Warshall algorithm gives T(/ n ) = 0(n 3 ). On the other hand, Kerr [H] has 
shown that also T(/ n ) = fi(n 3 ) holds. 

In Sect.0 we have shown that the monotone counting complexity of Path n is exponential in 
n. But, unlike bounds given in Sect.0 our proof for Path indirect and is based on two rather 
non-trivial known results: the fact that the clique polynomial Clique requires exponential 
monotone real circuits, and is a projection of the Hamiltonian s-t path polynomial Ham. 

Problem 2. Give a direct proof of C 0/1 (f) = 2 nQ(1) for f = Path n . 

Finally, it would be interesting to extend to the case of counting {+, x}-circuits one of 
the first lower-bounds arguments for computing {+, x}-circuits suggested by Schnorr in [T7j. 
Namely, he proved that C(/) ^ |mon(/)| — 1 holds, if the polynomial / is separated in the 
following sense: for every two monomials p ^ q of /, their product pq does not contain any 
third monomial r 0 {p, q} of / as a factor (see also [13[ Sect. 8] for a somewhat simpler 
proof). This criterion allows to easily prove strong lower bounds for some polynomials. For 
example, using it, one can easily show that C(/) ^ ((?) — 1 holds for the r-clique polynomial 
/ = Clique nr . This polynomial is separated, because the union of no two r-cliques (sets of 
edges of complete subgraphs of K n with r nodes) can contain a third r-clique. 

Problem 3. Can Schnorr’s argument for C(/) be extended to C 0 /i(f)? 
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